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Abstract 

> 

ly-^ I This paper sho'ws ho'w the theory of nonlinear adaptive observers can be effectively 

C^ ■ used in the design of internal models for nonlinear output regulation. The theory 

substantially enhances the existing results in the context of adaptive output regulation. 



in 

^ . 

C^ , by allo'wing for not necessarily stable zero dynamics of the controlled plant and by 

'nI" ■ weakening the standard assumption of having the steady state control input generated 

^^ . by a linear system. 

-(— > 
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.J 1 Introduction 

ci ■ The problem of controlling the output of a system so as to achieve asymptotic tracking of 
prescribed trajectories and/or asymptotic rejection of disturbances, sometimes known as the 
servomechanism problem, is continuing to attract a good deal of interest in control theory. In 
the last decade or so, most of the efforts have been addressed toward the design of controllers 
which solve this problem in the case of plants modelled by nonlinear differential equations. 
Viewed as a nonlinear design problem, some of the original features (such as, for instance, 
the conservation of the desired steady-state features in spite of plant parameter variations, 
otherwise known as "robustness" property, and the necessity of an "internal model" in any 
robust regulator) tend to lose their specific connotation. Rather, they merge with other 
relevant issues in feedback design for nonlinear systems, notably the guarantee of convergence 
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(for certain state variables) or boundedness (for other state variables) once a fixed set of initial 
data is given. After all, a problem of steering certain variables to a desired target value in 
the presence of exogenous stimuli generated by an autonomous "exosystem" , in a nonlinear 
context, can be viewed as a problem of adaptive control. Classically, adaptation is sought 
with respect to uncertain but constant parameters (which, of course, can be seen as exogenous 
inputs generated by a "trivial" autonomous exosystem) but if the parameters in question 
are obeying some fixed differential equation, it would not be inappropriate to continue to 
call a problem of this kind a (generalized) problem of adaptive control. It is because of 
this observation that an increasing use of methods and techniques from (nonlinear) adaptive 
control should be expected, so long as newer results in this research area will be generated. 

A specific feature of the problem in question is that, to achieve the desired steady-state 
features (perfect tracking), the controller should be able to generate a family of special inputs 
(those which, in fact, secure perfect tracking). If the external stimuli are constant (as in 
the case of uncertain constant plant parameters), this generator is simply provided by a 
bank of integrators (in the case of adaptive control, the state of each of such integrator is 
a parameter estimate). These integrators are to be "controlled" by appropriate feedback 
laws, so as to achieve the desired convergence and/or boundedness properties (in the case of 
adaptive control, this is the design of the "adaptation laws"). In a general servomechanism 
problem, the setting is very much the same: a model which generates all inputs needed to 
obtain perfect tracking is first found (the "internal model") and then some (generalized) 
stabilization law is superimposed to complete the design. In this respect, the design of a 
controller that solves the servomechanism problem is split in two parts: the design of an 
internal model and the design of a stabilizer. It must be observed, though, that the design of 
the former must be done with an eye to our ability to find the latter. This is a fact that was 
well understood in adaptive control. The addition of appropriate dynamics (notably the so- 
called "filtered transformations") are not strictly speaking needed to provide the dynamics 
of the unknown parameters (a trivial dynamics in that case), but rather are introduced to 
address the issue of stability. 

This being said, it is natural to expect an increasing interaction between the work on 
nonlinear adaptive control, nonlinear stabilization and nonlinear servomechanism theory. 
This interaction has already manifested itself in a number of recent contributions (such 
as [20], IS], [E], IB], |H], [H], whose results cannot be reviewed here for obvious reasons) 
and will manifest more in the contributions to come. In this paper, we wish to propose a 
method for design of an internal model which is based on some classical results in adaptive 
control: the design of adaptive observers for nonlinear systems which are linearizable by 
output injection. This method enables us to solve a servomechanism problem when the 
inputs needed to achieve perfect tracking can be seen as generated by a nonlinear system, 
linearizable by output injection, with possibly unknown coefficients. Allowing for unknown 
coefficients in this model automatically settles the issue of uncertain plant parameters (the 
classical "robustness" issue) as well the issue of parameter uncertainties in the exosystem 
(an outstanding design problem ffist addressed and solved, for a special class of systems, in 

j). Although the inspiration for the design is taken from an existing result in adaptive 



control, the application to the specific context of servomechanism theory looks pretty new 
and worth being pursued. 

2 Class of systems and main assumptions 

2.1 Preliminaries 

The purpose of this paper is to show how the theory of nonlinear adaptive observed can 
be effectively used in the design of adaptive output regulators for nonlinear systems. To 
motivate why and how adaptive observers play an important role in this design problem, 
it suffices to address the simplified case in which the controlled plant has relative degree 1 
between the control input and the regulated output. This is what is done here, for reason of 
space. The extension of the design methodology to system having higher relative degree can 
be found in the more extended paper 0, along with some additional technical details. 
Consider a system modelled by equations of the form 

z = fo{g,w,z) + fi{g,w,z,e)e .^. 

e = q{g,w,z,e) + u, 

with state {z, e) G R" x R, control input m G M, regulated output e G R, in which the 
exogenous inputs ^ G R^ and w G R"* are generated by an exosystem modelled by equations 
of the form 

^ = ^ , (2) 

w = s[g,w) . 

In this model, f) G R^ is a vector of constant uncertain parameters, the aggregate of a finite 
set of uncertain parameters affecting the controlled plant and another, possibly different, set 
of uncertain parameters affecting the generator of the exogenous input w. Note that system 
(P) has relative degree 1 between control input u and regulated output e. 

The functions /o(-), /i(-), g(-), ■s(-) in ((H) and are assumed to be at least continuously 
differentiable. The initial conditions of (^ range on a set Z x E, in which Z is a fixed compact 
subset of R" and i? = {e G R : |e| < c}, with c a fixed number. The initial conditions of 
the exosystem Q range on set P x W^ in which P and W are compact subsets of R^ and, 
respectively, W. In this framework the problem of output regulation is to design an output 
feedback regulator of the form 

u = 7(C,e) 

such that for all initial conditions {g{0),w{0)) E P x W and (z(0),e(0)) E Z x E the 
trajectories of the closed-loop system are bounded and limj^oo e(t) = 0. 

We retain in this paper some ideas introduced in 0, to which - to avoid duplications - 
the reader is referred. Among the concepts introduced and/or summarized in that paper, 
the notion of omega limit set a;(S) of a set S plays a major role. This concept is a deep 
generalization of the classical concept, due to Birkhoff, of omega limit set of a point and 



provides a rigorous definition of steady-state response in a nonlinear system (see PJ for 
details). 

Remark. The regulated variable e of (0) may coincide with the physical "controlled" output 
of a given plant, or may as well represents a tracking error, namely the difference between 
a physical "controlled" output and its "reference" behavior. Thus, the problem under con- 
sideration includes problems of tracking as well as problems of disturbance attenuation. < 



2.2 Basic hypotheses 

Augmenting ([T)) with (J2I) yields a system which, viewing u as input and e as output, has 
relative degree 1. The associated "augmented" zero dynamics, which is forced by the control 

c{g,w,z) = -q{g,w,z,0), (3) 

is given by 

Q = 

w = s{g,w) (4) 

z = fo{g,w,z). 

Occasionally, throughout the paper, we will rewrite the latter as 

z = fo(z) , (5) 

where z = col(^, w, z). Accordingly, we set Z = P x Pi^ x Z and replace c(^, w, z) by c(z) in 

©• 

In what follows, we retain three of the basic assumptions that were introduced in [Hj and 

express certain properties of the augmented zero dynamics (0)). The assumptions in question 

are the following ones: 

Assumption (i): the set P x ly is a differential submanifold (with boundary) of W x R*, 
invariant for Q. < 

Assumption (ii) : there exists a compact subset Z oi P xW x W^ which contains the positive 
orbit of the set Z under the flow of (0), and u){Z) is a differential submanifold (with boundary) 
oi P X W X W^. Moreover there exists a number di > such that 

zePxWxW, dist(z,cj(Z)) < di => zgZ. < 

Remark. Since the positive orbit of the set Z under the flow of (0) is bounded by hypothesis, 
the set co'(Z) is a nonempty, compact and invariant subset oi P x W x R" which uniformly 
attracts all trajectories of (0) with initial conditions in Z. It can also be shown (as in |i3j) 
that for every {g, w) E P x W there is ^ G M" such that {g, w, z) G uj{7i). <\ 



In what follows, for convenience, the set ci;(Z) will be simply denoted as ^o- The last 
condition in assumption (ii) implies that ^o is stable in the sense of Lyapunov. The next 
hypothesis is that the set ^o is locally exponentially attractive. 

Assumption (Hi): There exist M > 1, a > and d2 < di such that 
zo e PxW xW , dist(zo, Ao) < di => dist(z(t, zq), Aq) < Me~''*dist(zo, A) 

in which z(t, zq) denotes the solution of (0) passing through zq at time t = 0. < 

As is well known, a fundamental step in the construction of a controller which solves the 
problem of output regulation is the design on an "internal model", i.e. an autonomous dy- 
namical system which generates all "feed-forward inputs capable to secure perfect tracking" 
(in the present case, the set of all inputs of the form u{t) = c(z(t)), with z(t) a trajectory of 
the restriction of (0) to ^o)- In this respect, a relevant contribution to the design of internal 
models has been the methodology originally developed by Huang and co-authors (see e.g. 
[T^ El El)- As a matter of fact, in these works a precise characterization is provided of 
when the function u{t) in question satisfies a linear differential equation 

u^'^\t) + ad-iu^'^~^\t) + ■■■ + aM^\t) + aou{t) = 

which can then be taken as internal model and provides the fundamental core for the design of 
regulators. It was only recently, though, that attempts to weaken this condition have been 
taken. In [20], for instance, the case in which the coefficients of the above equation may 
depend on the uncertain (constant) parameter g was considered. Alternative and relevant 
extensions have also been proposed in the recent works [71 [S] . The extension to the case in 
which the equation above is nonlinear (but ^-independent) was treated in [1]. 

The present paper proposes an extension, in the design of internal models, to the case in 
which the autonomous dynamical system that generates u{t) is nonlinear but "linearizable 
by output injection", with coefficients which possibly depend on the uncertain (constant) 
parameter g. This case, to the best of our knowledge, has not been treated before by other 
authors. The assumption which characterizes when the extension in question is possible is 
the following one. 

Assumption (iv) : there exist a positive integer d, a C^ map 



r : Z 



pd 



z \-^ r(z) 
a C° map 



e : P 



P9 



g ^ 9{g), 

an observable pair {A, C) E R'^'"^ x R^^'^, and two C^ maps </> : M ^ R'^ and fi : M ^ R'^^^ 
such that the following identities (which we call immersion property) 

^ fo(z) = A r(z) + 0(Cr(z)) + fi(Cr(z)) 9ig) (6) 



c(z) = Cr(z) 



(7) 



hold for all z G ^o, Q ^ P- < 

Remark. Without loss of generality (see [T7| page 208]), we can assume throughout that 
the matrices A and C in jHI) have the form 



A 



/O 1 

1 



\0 



0\ 


1 

0/ 



c 



1 



0) 



Furthermore, note that since the maps Q{-) and 0(-) are continuously differentiable and the 
relations ® - © are supposed to hold over the compact set ^o, it can be assumed without 
loss of generality that functions 0(-) and Q{-) have compact support. This being the case, 
the functions in question can be assumed globally Lipschitz, i.e. there exist L,^ and Ln such 
that 

|0(Si) - 0(S2)| < L^\si - S2I, |f^(Si) - f^(s2)| < Lq\si - S2I, 

for all Si, S2. < 

Assumption (iv) can be rephrased by saying that for each initial condition z(0) G ^o of 
(0), there is a pair ^{0),9 such that the control input u{t) = c(z(t)) can be seen as output 
of a system of the form 

i = A^ + (l){y) + n{y)e 

6 = (8) 

y = Ci. 



2.3 Comparison with earlier work on adaptive regulation 

It may be useful to compare the assumption above with some of the standing assumptions 
in the earlier work [201 ^^ adaptive regulation. In framework of [201 , the lower subsystem of 
((21) was assumed to be a neutrally stable linear system 



w = S{g)w . 
Assumption III.l of ^JT\ was the existence of a map ( : P x W 

— S{g)w = fo{g, w, C(^, w)) , 



satisfying 



or, what is the same, of a map ( : P x W ^ M.^ whose graph is a compact invariant set for 
(^. Assumption V.l of [20! was that the graph of ( is globally asymptotically and locally 
exponentially stable. As a consequence, it is readily seen that Assumptions III.l and V.l of 



PUJ imply the fulfillment of assumptions (ii) and (iii) above and, in particular, the fact that 
the set ^0 is the graph of the map (. 

Assumption III. 2 of [201 was the existence of an integer q, oi a q x q matrix $(^), con- 
tinuously depending on ^, of a 1 x g matrix F such that the pair ($(f?), F) is observable for 
all g, and of a C^ map t : P x W —>■ M. satisfying the pair of conditions 



dr 



S{g)w 



dw 



Tt{p,w), 



which were referred to as conditions of "immersion" into a linear (observable) system. It is 
shown now that this assumption automatically yields assumption (iv) above. 

Since the pair ($(^),F) is observable for all g, there exist a matrix M{g), continuously 
depending on g, and continuous functions 9i{g), . . . , 9q{g) such that 



02{g) 



1 
1 











/ 



A{g) := M{gMg)M{g)-' = 

C := TM{g)-^ = ( 1 

The matrix A{g) can be written in the form A{g) = A + 6{g)C in which 6{g) is the column 
vector defined by the first column of A{g) and the pair {A, C) is observable. Setting f{g, w) = 
M{g)T{g,w), and fl{x) = xlq, it is readily seen that 



0) 



cig,w,CiQ,w)) 



Af{p,w) + n{Cfip,w))eig) 
Cf{p,w). 



This, bearing in mind the fact that ^o is the graph of (, shows that assumption III. 2 of [201 
implies the fulfillment of assumption (iv) above. 

The main limitation of the approach of [20] was the assumption of "immersion" into 
a linear system, namely the assumption that the set of inputs capable to secure perfect 
tracking is a subset of the set of solutions of a suitable linear (though ^-dependent) differential 
equation. To show that this limitation is overcome by the approach presented in this paper, 
we give here a simple but significant example. 

Example. Consider the regulation problem 

till = W2 

W2 = —uj'^wi 

Z\ = Z2 

Z2 = -azi - {zf - l)z2 -Wi + e 
e = —pzi + u 
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in which uo, a and /i are uncertain parameters ranging over compact sets. Note that uj 
is the uncertain frequency of a hnear exosystem, while a characterizes the frequency of a 
stable limit cycle embedded in the zero dynamics of the controlled plant. Note also that the 
equilibrium 2; = of the zero dynamics is unstable. 

Set Q = co\{u,a,fi) and z = co\{g,w,z). The function c(z) in this case is the function 
c(z) = fizi. Set now 



d{x, fx) = — ^x^ — 1 



/^ 



and 



T"3(z) 

tJz) 



fIZi 
fiZ2 + 
flWi - 
fJ,W2 - 



flZl 



d{x, fi)dx 




uo'^jj.Zi 



uo 



HZ2 



flZl 



d{x, fi)dx 



A simple calculation shows that the map r(z) thus defined satisfies conditions (jH)) and 
(|7j), with {A,C) an observable pair and 



My) 



(y\ 





^{y) 



l-y' 








\ 





-y 














-y 





V 








-y) 



m 



( V-" \ 

a 



3 The adaptive internal model 

3.1 The structure of the regulator 

As pointed out in jlj , the design of internal models can be reduced to the design of observers 
(non/mear observers, in that case). In the presence of uncertain parameters in the exosystem, 
an adaptive observer should be used. Bearing in mind the construction of adaptive observers 
for systems which are linearizable by output injection pioneered by Bastin and Gevers PP, 
we consider in what follows a candidate controller of the form 

ii + v 



u 

i 
e 

X 



Ai + 0(^1) + n{^i)d + H{X, ^,)v - M(X)dzv,(^) 
(3{X,i^)v-dzvfXe) 

Fx + Gn{ii) 



(9) 



in which ^1 denotes the first component of ^, the matrix X is a ((i — 1) x g matrix, M{X) is 
a d X q matrix defined as 

' 



M{X) 



X 



while the vectors H{X,^i), f3{X,C,i) and the matrices F,G have the form described below. 
The vector- valued dead-zone function dzvi{-) is defined as 

dzv^(col(si, . . . , Sg)) = col(dz^(si), . . . , dz^(sg)) 

in which dz£(-) is any continuously differentiable function satisfying 

( if Irl < / 

dz,(x) = <^ "^ r ^ . , 1 (10) 

^ ■^ \ X li \x\ > i + 1 ^ ' 

and the amplitude i of the dead- zone is chosen so that 

i > max 1^(0)1 . 

This controller can be viewed as a "copy" of (jHI), corrected by an "innovation term", aug- 
mented with an "adaptation law" for 6 and with a "filter" which generates the "auxiliary 
state" X. The additional input v, which is a "stabilizing control", will eventually be taken 
as f = —ke. 

The choice of the functions H{X,^i), j3{X,^i) and the matrices F, G of Q is inspired 
by certain calculations used in P and ^H] for the design of adaptive nonlinear observers. 
Define new variables 

e = e-e(g) 

(11) 

V = i-M{x)e. 

(note that r/i = ^1) and observe that, in the new variables, the second equation of (jH)) becomes 

77 = A{r] + M{X)d)+<p{7]i) + n{7]i){e{Q) + d) + H{X,T^i)v-M{X)e-M{X)(3{X,T^i)v 

= Ar/ + [AM{X) + ^(r^i) - M{X)]e + [H{X, r],) - M(X)/5(X, r],)]v + 0(r/i) + n{r]i)e{g) 

(12) 
The third equation, instead, becomes 

e = f3{X,r],)v-dzYe{e + e{g)). 

The choices of H{X, rji), i3{X, rji) and of F, G are meant to simplify the terms 

[AM{X) + n{r],) - M{X)]e + [H{X, r],) - M{X)f3{X, 7],)]v 

in the expression (J12p . First of all, note that choosing 

H{X,r],) = M{X)(3{X,r]i) + K 

with K a constant vector, to be fixed later, the second term becomes equal to Kv. The first 
term, instead, can be made equal to 

[AM{X) + fi(r/i) - M{X)]e = b(3'^{X, r]i)e 



in which b is a. d x 1 fixed vector, if M{X) satisfies 

M{X) = {A- bCA)M{X) + (/ - bC)Q{7]i) 

and /?(X, ?7i) satisfies 

(3^{X,r]i) = CAM{X) + Cfi(r/i) . 

In this way, the second equation of Q reduces to 

rj = Ar] + bp^{X, r]i)6 + Kv + 0(r/i) + QiviWig) ■ 



(13) 



To show that the required differential equation for X can be enforced, pick a column vector 
b = col(l, b2, . . . , bd). Then, bearing in mind the definition of M{X), it is easily realized that 
the required differential equation holds if the matrices F and G have the form (see 



/ 



V 



-bd-1 
-bd 



0\ 

1 
0/ 



G 



( 



\ 



-bd-i 
-bd 



0\ 

1 
1/ 



(14) 



In summary, the quantities H{X, C,i), l3{X, ,^i), F, G which appear in the controller (jH)) are 
determined as follows: F and G are the matrices in p4|) . while l3{X,C,i) and H{X,^i) are 
chosen as 



P{X,^i 



[CA[^)+ CQ{^r)f 



H{X,i, 



ni- A- 



Cn{i,)]^ + K. 



(15) 
(16) 



The vectors b and K are left undetermined, for the time being. 

The controller thus defined determines a closed loop system which, in the coordinates 
indicated above, can be written as 

^ = 

w = s{g,w) 

z = foig,w,z) + fi{g,w,z,e)e 

e = q{g,w,z,e)+r]i+v (17) 

rj = Ar] + bp'^{X,r]i)9 + Kv + ^{r]i) + n{r]i)9{g) 

e = (3{X,r],)v-dzYe{e + e{g)) 
X = FX + Gn{7]i). 



10 



This system, viewed as a system with input v and output e, has relative degree 1 and a zero 
dynamics characterized by the equations 

^ = 

w = s{g,w) 

z = foig,w,z) 

r] = Ar]-K[q{g,w,z,0)+7]i]+bl3^{X,7],)e + <f){r],) + n{7]i)eig) ^^^' 

9 = -P{X,r]^Mg,w,z,0)+r],]-dzy,{9 + 9{g)) 

X = FX + Gn{r]i). 

Standard arguments suggest that if the latter have convenient asymptotic properties, in 
particular possess a locally exponentially stable compact attractor, an additional control of 
the form v = —ke, (with large A; > 0) should be able to keep trajectories bounded and 
steer e(t) to zero. Thus, we proceed to analyze the properties of (fTHj). The intuition that the 
expected asymptotic properties hold is based on the observation that, in view of Assumption 
(iv), the fourth equation of (fTH|) can be regarded as the equation of an adaptive observer, 
constructed according to the methods of [1^ and fTH], for the variable t(z), with the fifth 
equation providing of the appropriate adaptation law. 

3.2 Trajectories of ( 1181 ) are bounded 

Let the initial conditions for g,w,z be taken in the set Z, a subset of a set Z which by 
hypothesis is positively invariant for the (autonomous) subsystem consisting the top three 
equations of ()18|) and consider the change of variables 

X = ri-T{g,w,z). 

Using (jH)) and (|7j) (which, it should be borne in mind, hold only on ^o ) system ()18|) becomes 

^ = 

w = s{g,w) 

z = foig,w,z) 

X = iA-KC)x + bf3^iX,xi + n)9 + Aixi,n,9) + cp{g,w,z) ^^^^ 

9 = -(3{X,xi+n)xi-dzve{9 + 9{g)) 

X = FX + GQixi + n), 
in which 

A(xi, Ti, 9) = 0(xi + n) - 0(xi) + Mxi + n) - nixiMg) 
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is a term which vanishes at Xi = and 

(p{g,w,z) = K{c{g,w,z) -Ti{g,w,z)) + AT{g,w,z)) + (f){Ti{g,w,z)) + Q{Ti{g,w,z))9{g) 

--^fo{Q,w,z)-—s{g,w) 

(20) 
is a term vanishing on ^o- In particular note that, since 0(-) and Q{-) can be taken to be 
globally Lipschitz and 6 ranges over a compact set, there exists a number L such that 

\A{xi,n,9)\ <L^\xi\+Ln\xi\\0\ < L\Xi\ 

for all Xij '^1; ^• 

Mimicking a construction used in ,1^ for the design of adaptive observers, the vectors 
6i's and K are chosen as follows. The fej's be such that the polynomial 

p{X) = X^-^ + h^X"-^ + ■■■ + bd-iX + hd (21) 

has d — 1 distinct roots with negative real part, in which case the matrix F in the bottom 
equation of p9|) is Hurwitz (and has distinct eigenvalues). On the other hand, K is chosen 
as 

K = Ab + \b (22) 

in which A > 0. These choices are such that the following result holds. 

Lemma 1 Suppose assumptions (i), (ii), (iv) hold. There is a number A* such that, if 
X > X* , all trajectories of l\iy\} are bounded. 

Proof. Because of assumption (ii), {g,w{t),z{t)) G Z for all t > 0, where Z is a compact 
set. Form this, standard arguments can be used to show that trajectories of (|T^ are defined 
for alH > and, consequently, also X{t) is bounded (recall that \fi{-)\ has compact support). 
To prove the Lemma it remains to show that also x(^) and 6{t) are bounded. To this end, 
let X bs partitioned as x = col(xi, X2), in which X2 is a (d — 1) x 1 vector and replace X2 by 

C = bxi + X2, 

where b = — col(62, &3, • • • , bj) ■ In this way, the fourth and fifth equations of (fT^ are changed 
to 

Xi = -Xxi + cC + /3''iX,xi + n)e + CA{xi,ri,9) + Cipig,w,z) 

C = FC + Cb I)A{xun,9) + Cb I)Cv{g,w,z) (23) 

9 = -p(X,xi + n)xi-dzYe{9 + 9{g)). 
Choose now for (|^H)l the Lyapunov function 

Vixi,C,0)=xi + ePC + 0'^0, (24) 

12 



in which P is the positive definite solution of PF + F^ P = —I and obtain, after some simple 
algebra, 

V < -2\xl-\C?-29^dzYei9 + 9ig)) + L^\xi\' + L,\xi\\C\ ,_, 

\ ) 

+L3\Xi\\<^{q,w,z)\ + Li\(\\if{g,w,z)\ 

for some Li > 0, i = 1 . . . ,4. Bearing in mind the fact that ip{g, w, z) is bounded by some 
fixed number (^ > and completing the squares, one obtains 

1/ < _(2A - Li + ]^Ll)xl - \\C? - ^e'^dzM.ie + e{Q)) + ^xAv + i^4|CI<^ • (26) 

A property of the function ()10|). in view of the choice of £, is that 

^^dzv^(^ + e{Q)) > for all 9 eW and geP. (27) 

Moreover, for any 6 > i/^(2£ + 1) there is a number ci > such that 

\e\>6 => 2e^dzvi{e + e{g))>ci\e\'^ forall^GM'? and geP. (28) 

If A is large enough, inequality (^E]). in view of property (f^ . yields 

\0\>6 => V < ~C2\{xiX,0)\' + C3\{xiX,0)\v 
for suitable C2 > 0, C3 > 0. This, in turn, yields 

\e\>6 and \{xiX,0)\>—^ => V<0. (29) 

C2 

Property (jTTj) . on the other hand, yields 

V^<-C2|(xi,C)r + C3|(xi,C)l^ 

which, in turn, yields 

l(Xi,C)l>-^ => V<0- (30) 

C2 

At this point, it is easy to conclude that (j^ and (jHUj) imply 



\(x^x,o)\>J5^+[fip) => y<o, 



Bearing in mind the fact that V{xi, C, 0) is a quadratic form, the claim follows by standard 
arguments. < 
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3.3 The limit set of ( 1181) and its properties 

Let the initial conditions ri{0),6{0),X{0) of (fTHj) be taken in fixed compact sets H, 6, X. 
From Lemma C] we can claim that, if A is large enough, the positive orbit of the set 

B = PxVrxZxHxexX 

under the flow of (|18p is bounded. As a consequence uj(B), the Lj-limit set of B under the flow 
of (fTHj) . is a non-empty, compact and invariant set, which uniformly attracts all trajectories 
of (fTHj) with initial conditions in B. In what follows we render the structure of a;(B) explicit. 
To this end, we need an extra hypothesis, which - as any well-educated reader in adaptive 
control is expecting - plays in the present context a role completely similar to the role of the 
classical hypothesis of persistence of excitation. 

Consider the equivalent system (fT^ and rewrite the three top equations as in (0) (con- 
sistently rewrite (f{g, w, z) as ipiz) and r(z, w, g) as r(z)). Because of the special triangular 
structure of (jT^. it can be observed that if (z, x, 6, X) is a point of ci;(B), necessarily z is a 
point in the tu-limit set of Z under the flow of (0), that is, z is a point of ^o- This implies 
that on uj{Q) we have (/'(z) = and thus system (|19p simplifies as 



z = fo(z) 

e = -/5(X,xi + ri)xi-dzv,(^>0(f?)) 
X = FX + GQixi + n). 



(31) 



It will be shown now that, if the announced additional hypothesis of persistency of 
excitation holds, points of uj(B) have necessarily x = 0, ^ = 0. To introduce the hypothesis 
in question we observe first of all the following interesting feature. 



Lemma 2 The graph of the map 

a : Ao ^^ 

z ^ X= I e-'''Gn{ri{z{s,z)))ds 



D(a!-l)xg 

r-0 

-Fs, 



oo 



is invariant for 



z = fo(z) 
X = FX + Gn{Ti{z)). 



(32) 



Proof. Let z(t, zq) denote the solution of (0) passing through zq at time t = and note 
that, if Zq G ^05 then z(t, zq) G ^o for all t. Since F is a Hurwitz matrix, the map a{-) is 
well defined. A simple calculation shows that 

a(z(t,zo))=e^V(zo)+ / e^(*-^)Gfi(ri(z(s, zo)))rfs , 

Jo 
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from which the result follows. < 

The new assumption is the following one. 

Assumption (v): Consider the map 7 : ^0 ~^ M.'^^^ defined as 

7:z ^ /3(o-(z),ri(z)) 

It is assumed that for any initial condition zq G ^0 the identity 

c'^7(z(t, zo)) = 0, for alH G M 

implies c = 0. < 

Under this hypothesis, the set co'(B) assumes a very simple structure. As a matter of 
fact, the following result holds. 

Proposition 1 Under the assumptions (i),(ii),(iv) and (v) the set uj{Q) is the graph of a 
continuous map defined on Aq. Any point o/a;(B) is a point {z,ri,9,X) in which z G ^0 
and 

r] = T{z), 6 = 0, X = cj{z). 

If also assumption (Hi) holds, then uj(B) is locally exponentially attractive for il^). 

Proof. By contradiction, suppose a point p = (z,xo5^05-^) with either xo 7^ or 6*0 7^ 
is in cc;(B). Since ci;(B) is compact and invariant, the backward trajectory of (jHT|) starting 
at this point is bounded. Along this trajectory, the Lyapunov function (j^ satisfies V < C 
for all t < 0, for some C > 0. Moreover, since v'(z) = on ci;(B), the same computations 
indicated in the proof of Lemma Q show that 

V{t) < -(2A - Li - hl)\xi{t)\' - ^iCWr - 29{t)dzY,m + 9{g)) . 

Using property (j77|) it is seen that, if A > A*, V(t) is non-increasing along trajectories. As 
consequence, since V(t) is bounded, there exists a finite number Va such that lim^^.oo V(t) = 
Va ■ The trajectory in question is attracted, in backward time, by its own a-limit set a(p), 
which, as it is well known, is nonempty, compact and invariant. Moreover, by definition, 
the function V{xi,Cj(^) has the same value Va at any point of a(p). Proceeding as in the 
classical proof of LaSalle's invariance principle, pick an initial condition p in the set a(p) 
and consider the corresponding trajectory of (j3ip . Along such trajectory, V{t) is constantly 
equal to Va and hence 

X^{t) = 0, CW = 0, dzv£(^(t) + 9(0)) = for all t G M. 
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Entering these constraints in (j31|) . and observing that the vector b is nonzero, it is seen that 
necessarily 

e = o 

X = FX + Gn{Ti{z)) . 

It is seen from this that 6{t) is a constant, say 6*, along such trajectory, while X{t) is a 
solution of (jHH). Since F is Hurwitz and has distinct eigenvalues, X{t) can be bounded for 
t < only if X{0) = cr(z(0)), where a{-) is the map introduced in Lemma |2l in which case 
X(t) = a{z{t)). Since X{t) has to be bounded because a(p) is compact, it follows that X{t) 
is necessarily equal to cr(z(t)). This being the case, bearing in mind the expression of /5(-, ■) 
and the definition of the map 7(-), the first condition shows that necessarily 

(r)^7(z(t)) = 0, for all t G M. 

Thus, from Assumption (v), it is concluded that 9* = 0. As a consequence (xi, C; ^) = (0, 0, 0) 
at any point of a(p), and Va = 0. But this is a contradiction, because V(t) is non-increasing 
along trajectories and V^(0) is strictly positive, if either xo 7^ or ^o 7^ 0. 

The proof that uj(B) is locally exponentially stable is a consequence of Assumption (iii). 
It requires appropriate modifications of arguments used in similar instances in the proof 
of convergence of parameter estimates in various adaptive control schemes, such as those 
presented in various Chapters of y^, and is not included here for reasons of space. Details 
can be found in [9,. < 



4 Adaptive output regulation 

We return now to the closed loop system obtained from the interconnection of (P), (0) and 
©. As observed, this system, viewed as a system with input v and output e has relative 
degree 1. To put it in "normal form" we use, instead of (jlip . the change of variables 

= 9-9ip)- j P{X,^,-CKe + CKs)ds 
7] = i-M[9- 9{p)] - Ke . 

This, after some simple algebra and some obvious rearrangement of terms, yields a system 
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of the form 

^ = 

li) = s{g,w) 

z = fo{g,w,z) + fi{g,w,z,e)e 

f] = Ar] + b(3^e{g)-K[q{Q,w,z,0)+7]i]+(f){r]i) + n{7]i)e + 5i{g,w,z,e,X,r]i)e 

9 = -P[q{g,w,z,0) + r]i]+62{g,w,z,e,X,r]i)e-dzvi{9 + 9{g)) 

X = FX + GQ{7]i) + 63{r]i,e)e 

e = -[q{g,w,z,0)+rii]+i!}{g,w,z,e)e + v. 

(34) 
in which Si{-) , 62{-) , S^l-) and 'i9(-) are continuously differentiable functions of their arguments. 
The notation /3 stands for (3{X, rji + CKe). 

This system can be put in a much more compact form by setting 

X = co\{g,w,z,7],9,Xi,. . .Xq) , 

(where Xi denotes the i-th column of X) which yields a system of the form 

X = Fo(x) + Fi(x,e)e 

(35) 
e = h(x) + k(x, e)e + f . 

In this notation, the "subsystem" x = Fo(x) is precisely system (|18p . while the function 
h(x), which is precisely the quantity —[q{g,w,z,Q) + ^i] in (jH^ . vanishes on the set co'(B). 
Having realized this, it is not difficult to claim that the controller Q completed with 

V = —ke , (36) 

if k is sufficiently large, keeps trajectories bounded and steers e{t) to 0. 

Proposition 2 Consider system (QJ) with exosystem (0). Let Z, E he fixed compact sets of 
initial conditions, for which the assumptions (i)-(iv) indicated in section\^ are supposed to 
hold. Suppose, in addition, that assumption (v) introduced in section VJ/J[ holds. Consider 
the controller (0) completed with VJ(^) and initial conditions in a fixed compact set K. Then, 
there exists a number k* > such that if k > k* the positive orbit ofZxExK. in the closed 
loop system is bounded and e{t) ^ as t —^ oo. 

Proof. The closed-loop system 

± = Fo(x) + Fi(x,e)e 
e = h(x) + k(x, e)e — /ce . 
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can be viewed as interconnection of two subsystems, one with state x and input e, the other 
with state e and input x. As shown in j3j, the upper subsystem is input-to-state stable 
(relative to the set uj{B)), with a gain function which is linear if the assumptions (i) through 
(v) hold. Then, an easy extension (to the case of systems which are input-to-state stable 
relative to compact attractors) of the small-gain theorem of ^S] can be invoked to show that, 
if k is large enough, the results of the Proposition hold. Further details on the proof of this 
"high-gain" stabilizability property can be found in [Hj. < 

Before concluding the paper, we wish to point out the fact that the theory developed so 
far lends itself to deal with more general situations in which the equations of the (augmented) 
exosystem are affected by regulated variable e. Specifically, suppose that g and w, instead of 
(j21) , are generated by a system of the more general form 

g = Sg{g,w,z,e)e ,^^. 

w = s{g,w) + Sw{g,w, z,e)e . 

In this case, in fact, the closed loop system obtained from the interconnection of ([Q), (j38|) 
and (jHI) can still be put in the form (|35p. in which fo(z) has exactly the form Q, while 

/ s^{g,w,z,e) 

fi(z,e) = I s^{g,w,z,e) 

\fi{g,w,z,e) 

Thus, the result expressed by Proposition El continues to hold. Models of this kind occur, for 
instance, in the problem of self-compensation of mechanical and/or electrical asymmetries 
in a rotating electrical drives (see j2]). 

5 Conclusions 

This paper has discussed the design of nonlinear internal models in the problem of adaptive 
output regulation. It has been shown how the theory of adaptive observers can be successfully 
used to deal with complex situations, not covered by existing results, in which the desired 
steady state control input is generated by a possibly nonlinear system and depends on 
constant uncertain parameters. The result is framed in the general "non-equilibrium" theory 
proposed in , thus allowing for controlled plant with not necessarily stable zero dynamics. 
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